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By  exploiting  the  (prior)  knowledge  that  certain  microstructural  features  should,  on  average,  have  a  certain  symmetry,  it  was 
possible  to  develop  an  automated  technique  for  identifying  their  locations  within  a  complex  micro  structure.  Subsequently,  this  tech¬ 
nique  is  applied  to  a  single-crystal  Ni-based  superalloy  to  identify  dendrite  core  locations  by  using  their  fourfold  symmetry  as  viewed 
along  the  (10  0)  growth  direction.  Results  of  such  a  technique  show  good  agreement  with  time-intensive  manual  identification  of 
dendrite  core  locations. 

©  2009  Acta  Materialia  Inc.  Published  by  Elsevier  Ltd.  All  rights  reserved. 
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Serial  sectioning  techniques  and  increasing  im¬ 
age  resolution  is  leading  to  an  abundance  of  image  data 
for  characterizing  the  three-dimensional  (3-D)  structure 
of  material  micro  structures  [1-7].  As  advances  in  these 
areas  continue,  there  is  an  increasing  need  to  process  this 
information  in  an  automated  manner  to  extract  useful 
microstructural  statistics  [8-10].  Interestingly,  in  materi¬ 
als  science  applications,  symmetry  often  plays  a  role  in 
the  development  of  micro  structure  (especially  in  crystal¬ 
lography),  yet  symmetry  is  seldom  used  for  image-pro- 
cessing  techniques. 

The  present  paper  discusses  an  automated  image  pro¬ 
cessing  technique  for  extracting  symmetric  features  in 
microstructural  images.  Subsequently,  this  technique  is 
applied  to  a  single  crystal  Ni-based  superalloy  to  iden¬ 
tify  dendrite  core  locations  by  using  their  fourfold  sym¬ 
metry  as  viewed  along  the  (10  0)  growth  direction. 
Application  to  this  particular  problem  is  motivated  by 
the  large  amount  of  time  required  to  manually  identify 
dendrite  cores  on  each  serial  slice.  Typical  data  sets 
can  contain  50  or  more  serial  slices  with  at  least  250  den¬ 
drite  cores  per  slice,  so  the  time  required  to  manually 
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identify  these  features  is  substantial.  As  the  number  of 
slices  and  dendrite  cores  increase,  automated  ap¬ 
proaches  for  extracting  the  dendrite  core  locations  is 
clearly  required.  The  significance  of  this  technique  is 
that  it  can  be  extended  to  include  any  symmetry  features 
such  as  mirror  planes,  improper  rotations  or  color  sym¬ 
metry,  by  using  suitable  matrix  representations  of  these 
operations.  For  simplicity,  only  the  fourfold  rotation  is 
included  in  this  work. 

Figure  1  shows  an  etched  optical  image  montage  for  a 
serial  slice  perpendicular  to  the  nominal  growth  direc¬ 
tion  of  a  single  crystal  Ni-based  superalloy  (PWA 
1484)  turbine  blade,  which  was  fillet  cut  through  the 
interior  passage.  The  green  (small)  box  is  an  image 
showing  a  single  dendrite  as  viewed  from  the  (10  0) 
growth  direction  and  is  used  for  describing  the  algo¬ 
rithm  in  Figure  2.  The  blue  (intermediate)  box  is  an  im¬ 
age  of  a  group  of  dendrites  along  with  eutectic  particles 
(bright  particles  within  the  interdendritic  area),  which  is 
used  to  assess  the  symmetry-based  technique  (Fig.  3). 
Finally,  the  red  (large)  box  delineates  a  6  mm  x  6  mm 
subset  of  the  turbine  blade  that  is  subsequently  used  to 
test  the  technique  on  a  microstructural  area  with  a  large 
number  of  features  that  can  bias  the  calculation  (i.e. 
both  the  mount  material  and  eutectic  particles). 

Conventional  image  processing  uses  only  the  inten¬ 
sity  information  in  the  image,  which  is  conventionally 
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Figure  1.  This  image  montage  shows  the  microstructure  of  a  cross-section  of  a  single-crystal  Ni-based  superalloy  turbine  blade.  The  red,  blue  and 
green  boxes  highlight  microstructural  areas  used  for  the  symmetry-based  technique.  (For  interpretation  of  the  references  to  color  in  this  figure  legend, 
the  reader  is  referred  to  the  web  version  of  this  paper.) 
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Rotated  images 


Figure  2.  This  schematic  shows  how  a  single  pixel  within  the  image  is 
processed  using  the  fourfold  symmetry  filter,  (a)  300  pm  x  300  pm 
local  image  (b)  surrounding  a  single  pixel  within  (a)  is  chosen  and 
rotated  in  90°  increments  to  produce  (c-e).  Image  (f)  is  the  average  of 
the  four  rotated  images  and  (g)  is  the  corrected  average  for  the  mount 
material  and  eutectic  particles  (not  required  here).  Image  (h)  shows  the 
deviation  between  image  (g)  and  image  (b).  The  inverse  of  the  sum  of 
the  values  in  image  (h)  is  the  fourfold  symmetry  parameter  for  the 
starting  pixel. 


known  as  “observation  information”.  This  work  builds 
on  conventional  methods  by  including  the  “prior  infor¬ 
mation”  that  the  cores  should,  on  average,  have  fourfold 
symmetry,  when  viewed  along  the  (10  0)  growth  direc¬ 
tion.  This  is  shown  in  Figure  1.  The  observation  infor¬ 
mation  would  be  the  differences  in  intensity  and 
textures  for  the  different  constituents  of  the  image:  the 
mount  material,  the  dendrites,  the  eutectic  particles 
and  the  interdendritic  region.  Combining  this  observa¬ 
tion  information  with  the  prior  information  of  the  sym¬ 
metry  allows  automatic  identification  of  the  cores. 

By  calculating  a  quantitative  symmetry  parameter  for 
each  pixel  in  an  intensity  image,  those  pixels  in  local 
neighborhoods  with  a  high  fourfold  symmetry  parame¬ 
ter  can  be  detected  using  a  simple  threshold.  Figure  2 


shows  a  schematic  of  how  the  symmetry  parameter  is 
evaluated  for  a  single  pixel. 

The  red  (large)  image  from  Figure  1  is  shown  in  Fig¬ 
ure  2a.  The  fourfold  symmetry  parameter  for  a  single 
pixel  within  this  image  is  calculated  as  follows: 

(1)  A  single  pixel  within  Figure  2a  is  chosen  to  cal¬ 
culate  the  fourfold  symmetry  parameter.  Then, 
a  local  neighborhood  around  the  pixel  is  identi¬ 
fied  for  a  particular  length  scale  (e.g.  300  pm  x 
300  pm  in  Fig.  2)  and  the  associated  intensity 
image  of  this  neighborhood  is  used  for  the 
fourfold  symmetry  filter  (Fig.  2b). 

(2)  The  intensity  image  (Fig.  2b)  is  subsequently 
rotated  by  90°  three  times  to  produce  the  images 
shown  in  Fig.  2c-e. 

(3)  A  local  average  intensity  image  (Fig.  2f)  is  calcu¬ 
lated  from  the  four  rotated  images  in  Figure  2b- 
e.  When  there  are  features  within  the  local  neigh¬ 
borhood  that  should  not  be  taken  into  account 
for  the  fourfold  symmetry  parameter,  the  aver¬ 
age  intensity  image  may  need  to  be  corrected. 
Figure  2g  is  the  result  after  accounting  for  these 
features  (no  effect  in  this  example). 

(4)  Figure  2h  shows  an  image  of  the  deviation  at 
every  pixel  between  the  intensity  values  in  Fig¬ 
ure  2  g  and  b,  where  black  pixels  indicate  a  rela¬ 
tively  low  deviation.  The  l2- norm  (square  root  of 
the  sum  of  the  squares  of  the  pixels)  is  inverted 
to  calculate  the  symmetry  parameter  of  the  local 
neighborhood  for  the  single  starting  pixel. 

To  test  the  applicability  of  the  fourfold  symmetry 
filter  to  extracting  dendrite  core  locations,  the 
1 .4  mm  x  1 .4  mm  blue  (intermediate)  image  was  se¬ 
lected  from  the  serial  slice.  Three  different  neighborhood 
sizes  were  used  to  investigate  the  influence  of  neighbor¬ 
hood  size  on  the  results:  100,  200  and  300  pm.  Figure  3 
shows  the  resulting  images  for  the  fourfold  symmetry 


2 


M.  A.  Tschopp  et  al.  I  Scripta  Materialia  62  (2010)  357-360 


359 


filter  using  neighborhood  sizes  of  100  jim  (a),  200  jim  (b) 
and  300  jam  (c).  Visual  comparison  of  the  dendrite  core 
locations  in  the  original  image  (Fig.  1,  blue)  with  the 
fourfold  filtered  images  shows  that  the  intensity  is  high 
in  the  dendrite  core  locations.  However,  the  intensity 
is  also  often  high  in  the  secondary  arms  and  sometimes 
in  the  interdendritic  area,  so  a  simple  threshold  at  any 
length  scale  may  be  inadequate  for  segmenting  the  den¬ 
drite  core  locations  from  these  filtered  images.  The  ori¬ 
ginal  intensity  information  can  also  be  useful  for 
detecting  the  correct  symmetric  features  (e.g.  distin¬ 
guishing  fourfold  symmetric  dendritic  regions  from 
fourfold  symmetric  interdendritic  regions).  Also,  notice 
that  the  eutectic  particles  in  Figure  3a-c  are  shown  in 
black.  This  does  not  reflect  an  absence  of  fourfold  sym¬ 
metry  in  these  particles;  rather,  the  eutectic  particles 
were  previously  segmented  and  are  accounted  for  in 
the  fourfold  symmetry  filter  so  they  do  not  affect  the 
extraction  of  the  dendrite  core  locations. 

The  technique  was  made  more  robust  by  segmenting 
the  dendrite  core  locations  with  a  vector-based  segmen¬ 
tation  approach  using  the  fourfold  symmetry  parame¬ 
ters.  In  this  manner,  each  pixel  within  the  original 
image  has  a  vector  associated  with  it  that  reflects  infor¬ 
mation  from  multiple  length  scales.  For  example,  in  this 
case,  the  fourfold  symmetry  parameters  for  local  neigh¬ 
borhood  sizes  of  100,  150,  200,  250  and  300  pm  were 
used  to  construct  a  vector-based  image  to  help  segment 
the  dendrite  cores.  Then,  the  dimensionality  of  this  vec¬ 
tor-based  image  is  reduced  by  taking  the  l2- norm  of  the 
vector  within  each  pixel  and  multiplying  by  the  original 
intensity  image  (to  further  reduce  peaks  in  secondary/ 
tertiary  dendrite  arms  and  interdendritic  areas).  Again, 
the  intensity  information  of  the  original  image  is  used 
to  differentiate  fourfold  symmetry  in  the  dendrite  cores 
from  that  in  the  interdendritic  regions.  Additionally, 
weighting  the  fourfold  symmetry  parameter  at  different 
length  scales  with  the  corresponding  standard  deviation 
of  the  local  neighborhood  intensities  is  important  for 
smaller  length  scales  where  high  fourfold  symmetry 
parameters  may  reflect  that  the  homogeneity  of  intensi¬ 
ties  within  a  local  neighborhood  rather  than  the  actual 
fourfold  symmetry  (e.g.  the  local  region  lies  entirely 
within  a  dendrite  arm).  Figure  3d  shows  the  resulting 
image  after  applying  a  Gaussian  smoothing  operation 


and  a  morphological  top  hat  filter.  Notice  that  the  image 
contrast  has  vastly  increased  over  the  images  at  the  var¬ 
ious  length  scales  (Fig.  3a-c).  Also,  the  dendrite  cores 
appear  much  brighter  than  the  dendrite  arms,  which  dis¬ 
play  twofold  symmetry. 

The  resulting  image  from  the  multiscale  fourfold 
symmetry  filter  can  now  be  segmented  to  extract  the 
dendrite  core  locations.  Prior  to  this  point,  the  fourfold 
symmetry  filters  can  operate  in  an  automated  fashion 
requiring  no  user  intervention.  While  various  automated 
segmentation  methods  exist  (e.g.  [8,9]),  this  image  is  eas¬ 
ily  segmented  using  a  user-defined  threshold  parameter. 
In  this  image,  the  range  of  user-defined  intensity  thresh¬ 
olds  that  correctly  identified  all  dendrite  core  locations 
was  quite  large  (range  of  142-204  when  this  image  was 
rescaled  to  an  8-bit  image).  Figure  3e  superimposes  the 
segmented  dendrite  core  locations  (in  red)  obtained 
using  a  threshold  parameter  of  145  onto  the  original 
intensity  image.  This  technique  identified  all  the  dendrite 
cores  while  only  requiring  the  manual  manipulation  of  a 
single  parameter  (the  threshold  parameter). 

Extending  the  fourfold  symmetry  filter  to  the  large 
image  in  Figure  1  requires  accounting  for  the  adverse  ef¬ 
fects  due  to  the  mount  material  and  eutectic  particles. 
For  instance,  in  local  neighborhoods  that  contain  the 
mount  material,  the  fourfold  symmetry  would  be  extre¬ 
mely  low  for  a  dendrite  core  near  the  boundary.  There¬ 
fore,  the  mount  material  needs  to  be  accounted  for  in 
the  symmetry  filter.  Moreover,  the  eutectic  particles 
can  decrease  the  fourfold  symmetry  parameter  in  a  sim¬ 
ilar  way  to  the  mount  material.  In  prior  work  [11],  the 
mount  material  and  eutectic  particles  were  segmented 
for  sixteen  6  mm  x  6  mm  successive  serial  images  spaced 
~10  (im  apart.  The  location  of  this  region  is  shown  in 
Figure  1  by  a  red  box.  One  of  these  images  is  used  to 
show  the  result  of  accounting  for  the  mount  material 
and  eutectic  particles  in  the  fourfold  symmetry  filter. 

Figure  4  shows  the  original  image  with  superimposed 
segmented  dendrite  cores  in  red.  The  same  process  out¬ 
lined  schematically  in  Figure  2  was  applied  to  the  origi¬ 
nal  intensity  image.  To  account  for  the  mount  material 
and  eutectic  particles,  there  are  a  few  differences  from 
that  shown  in  Figure  2.  First,  the  average  image  in  Fig¬ 
ure  2g  is  modified  so  that  it  only  reflects  the  average  pix¬ 
el  intensities  in  areas  of  the  rotated  images  with  an 


Figure  3.  The  fourfold  symmetry  filter  was  applied  to  the  blue  image  in  Figure  1  using  neighborhood  sizes  of  (a)  100  pm,  (b)  200  pm  and  (c)  300  pm. 
The  multiscale  image  incorporates  this  information  (d)  and  the  dendrite  core  locations  are  then  segmented  and  shown  in  red  on  the  original  intensity 
image  (e).  (For  interpretation  of  the  references  to  color  in  this  figure  legend,  the  reader  is  referred  to  the  web  version  of  this  paper.) 
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Figure  4.  The  dendrite  cores  have  been  identified  (in  red)  in  a 
6  mm  x  6  mm  image  taken  from  a  serial  slice  using  the  fourfold 
symmetry  filter.  The  blue  circle  and  green  dots  refer  to  incorrectly 
identified  and  missed  dendrite  cores,  respectively.  (For  interpretation 
of  the  references  to  color  in  this  figure  legend,  the  reader  is  referred  to 
the  web  version  of  this  paper.) 


absence  of  the  mount  material  and  eutectic  particles. 
Second,  the  fourfold  symmetry  parameter  obtained 
from  the  difference  image  (Fig.  2h)  is  only  summed  over 
pixels  that  do  not  belong  to  the  mount  material  or  eutec¬ 
tic  particles.  Finally,  mount  material  or  eutectic  particle 
pixels  are  given  a  fourfold  symmetry  parameter  of  zero. 
Again,  Figure  4  shows  the  original  intensity  image  with 
the  dendrite  cores  identified  using  a  threshold  parameter 
(the  red  dots  have  been  enlarged  slightly  to  show  the 
dendrite  core  locations). 

To  assess  the  quality  of  this  technique,  the  results  of 
the  automated  symmetry-based  technique  were  com¬ 
pared  to  true  results  obtained  from  manual  identifica¬ 
tion  of  the  dendrite  cores.  The  symmetry-based 
technique  correctly  identified  93  dendrite  core  locations 
in  this  image  with  only  one  area  incorrectly  identified  as 
a  dendrite  core  (secondary  dendrite  arm  intersecting  a 
tertiary  arm  near  the  mount  material — circled  in  blue). 
Additionally,  14  dendrite  cores  at  the  mount  material/ 
microstructure  boundary  were  not  identified  (green 
dots),  but  might  have  been  identified  manually  depend¬ 
ing  on  the  operator.  These  dendrites  typically  contain 
only  two  dendrite  arms  that  intersect  close  to  the  bound¬ 
ary  (in  some  cases,  outside  of  the  boundary);  informa¬ 
tion  from  adjacent  slices  is  required  for  identification. 
Overall,  the  results  of  the  symmetry-based  technique 
are  good  considering  the  difficulty  of  accounting  for 
confounding  features  within  the  image.  As  can  be  ob¬ 
served  from  Figure  3,  this  technique  does  extremely  well 
without  these  confounding  features. 

This  symmetry-based  technique  can  considerably  re¬ 
duce  the  amount  of  time  spent  manually  identifying  all 
dendrite  cores  within  a  serial  image  the  size  of  Figure  1 


or  larger.  However,  at  this  point,  this  technique  still  re¬ 
quires  some  manual  intervention.  One  opportunity  is  to 
automate  the  segmentation  of  the  image  in  Figures  3d 
and  4,  eliminating  all  user  intervention.  Another  oppor¬ 
tunity  for  serial  images  is  to  incorporate  information 
from  adjacent  slices  to  augment  the  extraction  of  den¬ 
drite  core  locations.  A  continuity  rule  may  be  added 
for  both  missed  dendrite  cores  and  incorrectly  identified 
features.  For  instance,  a  dendrite  core  will  typically  ap¬ 
pear  on  multiple  slices.  For  missed  dendrite  cores,  the 
adjacent  slices  may  have  detected  dendrite  cores,  indi¬ 
cating  that  the  missed  dendrite  core  should  probably 
be  included.  For  incorrectly  identified  features,  the  adja¬ 
cent  slices  may  not  have  detected  dendrite  cores,  indicat¬ 
ing  that  the  incorrectly  identified  feature  is  not  a 
dendrite  core.  These  are  left  for  future  work,  but  are 
essential  for  fully  automating  this  process  to  construct 
the  3-D  dendrite  core  structure. 

In  summary,  an  automated  image  processing  tech¬ 
nique  for  extracting  symmetric  features  in  microstruc- 
tural  images  is  discussed  (shown  schematically  in 
Fig.  2).  This  technique  is  then  applied  to  a  single  crystal 
Ni-based  superalloy  to  identify  dendrite  core  locations 
by  using  their  fourfold  symmetry  as  viewed  along  the 
(10  0)  growth  direction.  Overall,  the  results  of  this  sym¬ 
metry-based  technique  are  good  (cf.  Figs.  3e  and  4)  and 
the  amount  of  manual  intervention  is  much  less  than  the 
manual  identification  of  all  dendrite  core  locations.  The 
significance  of  this  work  is  that  techniques  such  as  this 
will  be  instrumental  for  micro  structural  characterization 
of  materials  as  the  amount  of  imaging  information  con¬ 
tinues  to  increase. 

This  work  was  performed  at  the  Air  Force 
Research  Laboratory,  Materials  and  Manufacturing 
Directorate,  AFRL/RXLM,  Wright-Patterson  Air  Force 
Base,  OH. 
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